Determining Facial Expressions in Real-Time

In this paper we suggest an approach to describing and tracking the deformation of facial features. We concentrate on the mouth since its shape is important in detecting emotion, however we believe that our system could be extended to deal with other facial features. In our system, the mouth is described by a valley contour which is based between the lips. This contour is shown to exist independently of illumination, viewpoint, identity, and expression. We will present a realtime mouth tracking system that follows this valley. It will be shown to be robust to changes in identity, illumination and viewpoint. A simple classification algorithm was found to be sufficient t o discriminate between 5 different mouth shapes, with a 100% recognition rate.